Universal adaptive optics for microscopy through embedded neural network control.

The resolution and contrast of microscope imaging is often affected by aberrations introduced by imperfect optical systems and inhomogeneous refractive structures in specimens. Adaptive optics (AO) compensates these aberrations and restores diffraction limited performance. A wide range of AO solutions have been introduced, often tailored to a specific microscope type or application. Until now, a universal AO solution - one that can be readily transferred between microscope modalities - has not been deployed. We propose versatile and fast aberration correction using a physics-based machine learning assisted wavefront-sensorless AO control (MLAO) method. Unlike previous ML methods, we used a specially constructed neural network (NN) architecture, designed using physical understanding of the general microscope image formation, that was embedded in the control loop of different microscope systems. The approach means that not only is the resulting NN orders of magnitude simpler than previous NN methods, but the concept is translatable across microscope modalities. We demonstrated the method on a two-photon, a three-photon and a widefield three-dimensional (3D) structured illumination microscope. Results showed that the method outperformed commonly-used modal-based sensorless AO methods. We also showed that our ML-based method was robust in a range of challenging imaging conditions, such as 3D sample structures, specimen motion, low signal to noise ratio and activity-induced fluorescence fluctuations. Moreover, as the bespoke architecture encapsulated physical understanding of the imaging process, the internal NN configuration was no-longer a "black box", but provided physical insights on internal workings, which could influence future designs.

Deflectometry based calibration of a deformable mirror for aberration correction and remote focusing in microscopy.

Adaptive optics (AO) techniques enhance the capability of optical microscopy through precise control of wavefront modulations to compensate phase aberrations and improves image quality. However, the aberration correction is often limited due to the lack of dynamic range in existing calibration methods, such as interferometry or Shack-Hartmann (SH) wavefront sensors. Here, we use deflectometry (DF) as a calibration method for a deformable mirror (DM) to extend the available range of aberration correction. We characterised the dynamic range and accuracy of the DF-based calibration of DMs depending on the spatial frequency of the test pattern used in DF. We also demonstrated the capability of large magnitude phase control for remote-focusing over a range larger than was possible with SH sensing.

Wavefront-sensorless adaptive optics with a laser-free spinning disk confocal microscope.

Adaptive optics is being applied widely to a range of microscopies in order to improve imaging quality in the presence of specimen-induced aberrations. We present here the first implementation of wavefront-sensorless adaptive optics for a laser-free, aperture correlation, spinning disk microscope. This widefield method provides confocal-like optical sectioning through use of a patterned disk in the illumination and detection paths. Like other high-resolution microscopes, its operation is compromised by aberrations due to refractive index mismatch and variations within the specimen. Correction of such aberrations shows improved signal level, contrast and resolution.

Democratising "Microscopi": a 3D printed automated XYZT fluorescence imaging system for teaching, outreach and fieldwork.

Commercial fluorescence microscope stands and fully automated XYZt fluorescence imaging systems are generally beyond the limited budgets available for teaching and outreach. We have addressed this problem by developing "Microscopi", an accessible, affordable, DIY automated imaging system that is built from 3D printed and commodity off-the-shelf hardware, including electro-mechanical, computer and optical components. Our design features automated sample navigation and image capture with a simple web-based graphical user interface, accessible with a tablet or other mobile device. The light path can easily be switched between different imaging modalities. The open source Python-based control software allows the hardware to be driven as an integrated imaging system. Furthermore, the microscope is fully customisable, which also enhances its value as a learning tool. Here, we describe the basic design and demonstrate imaging performance for a range of easily sourced specimens.

Compact and contactless reflectance confocal microscope for neurosurgery.

Visual guidance at the cellular level during neurosurgical procedures is essential for complete tumour resection. We present a compact reflectance confocal microscope with a 20 mm working distance that provided <1.2 µm spatial resolution over a 600 µm × 600 µm field of view in the near-infrared region. A physical footprint of 200 mm × 550 mm was achieved using only standard off-the-shelf components. Theoretical performance of the optical design was first evaluated via commercial Zemax software. Then three specimens from rodents: fixed brain, frozen calvaria and live hippocampal slices, were used to experimentally assess system capability and robustness. Results show great potential for the proposed system to be translated into use as a next generation label-free and contactless neurosurgical microscope.

Active compensation of extrinsic polarization errors using adaptive optics.

We present a scheme for active compensation of complex extrinsic polarization perturbations introduced into an optical system. Imaging polarimeter is used to measure the polarization state across a beam profile and a liquid crystal spatial light modulator controls the polarization of the input beam. A sequence of measurements permits determination of the birefringence properties of a perturbing specimen. The necessary correction is calculated and fed back to the polarization modulator to compensate for the polarization perturbation. The system capabilities are demonstrated on a range of birefringent specimens.